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Abstract — The paper studies the routing in the network shared 
by several users. Each user seeks to optimize either its own 
performance or some combination between its own performance 
and that of other users, by controlling the routing of its given flow 
demand. We parameterize the degree of cooperation which allows 
to cover the fully non-cooperative behavior, the fully cooperative 
behavior, and even more, the fully altruistic behavior, all these as 
special cases of the parameter's choice. A large part of the work 
consists in exploring the impact of the degree of cooperation on 
the equilibrium. Our first finding is to identify multiple Nash 
equilibria with cooperative behavior that do not occur in the 
non-cooperative case under the same conditions (cost, demand 
and topology). We then identify Braess like paradox (in which 
adding capacity or adding a link to a network results in worse 
performance to all users) in presence of user's cooperation. We 
identify another type of paradox in cooperation scenario: when 
a given user increases its degree of cooperation while other 
users keep unchanged their degree of cooperation, this may 
lead to an improvement in performance of that given user. We 
then pursue the exploration and carry it on to the setting of 
Mixed equilibrium (i.e. some users are non atomic-they have 
infinitesimally small demand, and other have finite fixed demand). 
We finally obtain some theoretical results that show that for low 
degree of cooperation the equilibrium is unique, confirming the 
results of our numerical study. 

I. Introduction 

Non-cooperative routing has long been studied both in 
the framework of road-traffic as well as in the framework 
of telecommunication networks. Such frameworks allow to 
model the flow configuration that results in networks in which 
routing decisions are made in a non-cooperative and dis- 
tributed manner between the users. In the case of a finite (not 
very large) number of agents, the resulting flow configuration 
corresponds to the so called Nash equilibrium [17] defined 
as a situation in which no agent has an incentive to deviate 
unilaterally. The Nash equilibrium has been extensively used 
in telecommunications, see e.g. [2], [6]. The authors in [2] 
studied a routing games in which each user has a given 
amount of flow to ship and has several paths through which 
he may split that flow. Such a routing game may be handled 
by models similar to [8] in the special case of a topology 
of parallel links. This type of topology is studied in detail in 
the first part of [2] as well as in [9]. However, the model of 
[8] does not extend directly to other topologies. Indeed, in 
more general topologies, the delay over a path depends on 
how much traffic is sent by other users on any other path that 
shares common links. Routing games with general topologies 



have been studied, for example, in the second part of [2], as 
well as in [9]. A related model was studied thirty years ago 
by Rosenthal in [10], yet in a discrete setting. It is shown 
that in such a model there always exists a pure strategy Nash 
equilibrium. He introduces a kind of discrete potential function 
for computing the equilibrium. Nevertheless if a player has 
more than 1 unit to ship such an equilibrium doesn't always 
exist. 

In this work, we embark on experimental investigation of 
the impact of cooperation in the context of routing games. 
In particular we consider parallel links and load balancing 
network topology for investigation, originally presented in [2] 
and [7] in the context of selfish users. The experimentation 
is mainly aimed at exploring some strange behaviors which 
appears in presence of user's partial cooperation (Cooperation 
in Degree), which is further snengthened with some theoretical 
results. 

Firstly, we identify loss of uniqueness of Nash equilibria. 
We show by a simple example of parallel links and load 
balancing network that there may exist several such equi- 
libria. Moreover, even the uniqueness of link utilization at 
equilibria may fail even in the case of simple topology. A 
similar example of parallel links, in absence of the cooperation 
between users there would be a single equilibrium [2]. Beyond 
Nash equilibrium we investigate further in the setting of 
Mixed users i.e. where there are two types of users, Group 
user and Individual users. Group users seek Nash equilibrium 
while the Individual users seek equilibrium with Wardrop 
conditions. Strengthening our earlier finding, we observe loss 
of uniqueness with partial cooperation against the unique 
solutions shown in [15] for selfish users. However in the 
latter section (Sec. |V), we show theoretically that there exist 
uniqueness of Nash equilibrium under some conditions in the 
presence of cooperation between users. 

Secondly, we identify paradoxical behavior in presence of 
such cooperation. One of the observed paradox here is a kind 
of Braess paradox, a well studied paradox in routing context. 
Braess paradox has attracted attention of many researchers in 
context of routing games especially related to upgrading the 
system, see [4]- [7]. The famous Braess paradox tell us that 
increasing resources to the system leads to degraded perfor- 
mance in some cases. Such paradox is originally shown to exist 
in many scenarios, e.g. Braess network in [5], Load balancing 
network in [7]. Although such paradoxes are found even in 



the case of selfish users earlier, their existence even in case of 
such partial cooperation is highlighted here. We show that as 
the link capacity increases the overall cost of a user decreases 
i.e. addition of resources in the system can tentatively lead to 
degraded performance. Even more, we also identify another 
kind of paradox related to degree of Cooperation: When a 
user increases its degree of cooperation while other users keep 
their degree of cooperation unchanged, leads to performance 
improvement of that user. We also observe similar behavior 
even when other user also increase their degree of cooperation. 

The paper is structured as follows : In section [II] we present 
the system model, define our framework of cooperative user 
and, formulate the problem. Further in section [Til] we detail 
the numerical investigation and summarize the findings. Based 
on one of the findings, we depict more examples identifying 
Braess paradox in the setting of Nash game in subsection 
IIII-CI In section HVl mixed equilibrium is illustrated. In section 
[VI we develop theoretical results to show the conditions 
where uniqueness can be established in presence of users 
cooperation. In section [VT] we summarize the study of impact 
of cooperation. 

II. System model 

We consider a network (V, £), where V is a finite set of 
nodes and C C V x V is a set of directed links. For simplicity 
of notation and without loss of generality, we assume that 
at most one link exists between each pair of nodes (in each 
direction). For any link I = (u, v) £ C , define S(t) = u and 
D(l) = v. Considering a node v G V, let In(u) = {/ : D(l) = 
v} denote the set of its in-going links, and Out(u) = {I : 
S(l) = v} the set of its out-going links. 

A set T = {1,2, ...,/} of users share the network (V,£), 
where each source node acts as a user in our frame work. 
We shall assume that all users ship flow from source node 
s to a common destination d. Each user i has a throughput 
demand that is some process with average rate r*. User i splits 
its demand r % among the paths connecting the source to the 
destination, so as to optimize some individual performance 
objective. Let // denote the expected flow that user i sends 
on link I. The user flow configuration f = {f[) leC is called 
a routing strategy of user i. The set of strategies of user i that 
satisfy the user's demand and preserve its flow at all nodes is 
called the strategy space of user i and is denoted by F\ that 
is: 

r = {reRi £ i ; Y, fi= E fl + <,veV}, 

ieOut(i') ieln(v) 

where r\ = r' l ,r' l d = —r % and r' v = for v ^ s,d. The 
system flow configuration f = (J 1 ,...,/ 7 ) is called a routing 
strategy profile and takes values in the product strategy space 
F = ® 4€I F\ 

The objective of each user i is to find an admissible 
routing strategy f 4 £ F 4 so as to minimize some performance 
objective, or cost function, J\ that depends upon f 4 but also 



upon the routing strategies of other users. Hence J' (f) is the 
cost of user i under routing strategy profile f . 

A. Nash equilibrium 

Each user in this frame work minimizes his own cost 
functions which leads to the concept of Nash equilibrium. The 
minimization problem here depends on the routing decision of 
other users, i.e., their routing strategy 

r l = (f\...,f-\f +1 ,...f 7 ), 



Definition 1 A vector f\ i = 1,2,...,/ is called a Nash 
equilibrium if for each user i, f 1 minimizes the cost function 
given that other users' routing decisions are P , j ^ i. In 
other words, 

fCf 1 , f 2 , ...,¥) = min jVf 1 , f 2 , .., f\ f 7 ), 

i = l,2,...,I, (1) 

where F 1 is the routing strategy space of user i. 

Nash equilibrium has been discussed in the context of 
non-cooperative game with selfish users quite often in recent 
studies. 

In this paper we study a new aspect of cooperative routing 
games where some users cooperate with the system taking into 
account the performance of other users. We define this degree 
of Cooperation as follows : 

Definition 2 Let a' = (a\, .., Qfm) be the degree of Cooper- 
ation for user i. The new operating cost function J 1 of user 
i with Degree of Cooperation, is a convex combination of the 
cost of user from set X, 

^(f) = £4 J fe (f); £4 = l,i = l,...|Z| 

fcei k 

where J 1 (f) is a function of system flow configuration f with 
cooperation. 

Based on the degree of Cooperation vector, we can view the 
following properties for user i, 

• Non cooperative user : if a] = 0. 

• Altruistic user : User i is fully cooperative with all users 
and does not care for his benefits, i.e., a] = 1. 

• Equally cooperative - if a* = Jjt, user i is equally 
cooperative with each user j, where j eP^CI. 

Note that the new operating cost function of a user is the 
performance measure with degree of Cooperation, where it 
takes into account the cost of other users. Although a user 
cooperating with the system, it attempts to minimize its own 
operating cost function in the game setting. Hence such frame 
work can be classified under non-cooperative games and the 
thus we can benefit to apply the properties of non-cooperative 
games in such scenario. 




(a) Load balancing (b) Parallel links 



Fig. 1. Network Topology 



III. Numerical Investigation of the role of 

COOPERATION 

In this section we detail some numerical examples to study 
the routing game in the presence of cooperation between some 
users. In these examples, we use two types of cost functions 
: linear function which is often used in the transportation 
network and M/M/l function which is used in the queuing 
networks. We consider two network topologies : parallel links 
[2] and load balancing networks [6] which are defined below 

Load Balancing Network: A simple load balancing topology 
of network Q consists of 3 nodes is depicted in Fig. |l(a)| 
This topology has been widely studied in context of queuing 
networks. The nodes are numbered 1, 2, 3 and communication 
links among them are numbered as h,l2,h,h- Node 1,2 
acts as source node and node 3 acts as destination node. 
Link Zi,?2 are directed links for nodes 1,3 and nodes 2,3 
where as, link I3, U are directed link for nodes 1, 2 and nodes 
2,1. Cost function of user i is the sum of cost of each link 

Jl = £jg{i,.„4} //TO) ' where TO) is the link cost 

function. The cost of each user i with cooperation can be 
defined as below, 

J 1 = E E «*/*TO) (2) 

ie{i,...4} fce{i,2} 

Parallel Links Network: A simple parallel links topology of 
network Q consists of 2 nodes is depicted in Fig. |l(b)| which 
is originally discuses in [2]. The nodes are numbered 1, 2 and 
communication links between them are numbered as 
Node 1 acts as source node and node 2 acts as destination 
node. Cost function of user i is the sum of cost of each 

link J* = Eie{i,2} //TO) . where TO) is the link cost 
function. The cost of each user i with cooperation can be 
defined as below, 

? = E E 4/*to) (3) 

ie{i,2} fce{i,2} 

For each network topology, we consider both the cost functions 
for investigation. 

Linear Cost Function: Linear link cost function is defined 
as, Ti(f h ) = a { f h + gt for link i = 1,2, where as, Xi(/ (j ) = 
c .fij + d for link j = 3, 4. 

M/M/l Delay Cost Function: The link cost function can be 
defined as, Tz(/z;) — ^ L_ j where Ci i and fi ( denote the 
total capacity and total flow of the link U. Note that this cost 



represents the average expected delay in a M/M/l queue with 
exponentially distributed inter arrival times and service times 
under various regimes such as the FIFO (First In First Out) 
regime in which customers are served in the order of arrivals, 
the PS (Processor sharing) regime and the LIFO (Last In First 
Out) regime. This same cost describes in fact the expected 
average delays in other settings as well such as the M/G/l 
queue (exponentially distributed inter arrival times and general 
independent service times) under the PS or the LIFO regime. 

A. Numerical Examples 

We consider two users share a network. We distinguish two 
cases. An asymmetric case in which the user 1 is cooperative 
with a{ > and user 2 is noncooperative, i.e., a 2 , = 0. 
The second case is symmetric case in which both users 
are cooperative with the same degree of cooperation a. We 
compute the Nash equilibrium at sufficiently many points of 
degree of Cooperation a in the interval [0,1] and plot the 
corresponding user cost and user flow. Here user flow signifies 
the fraction of demand flowing in the corresponding user 
destination link. Since we consider only two links, the fraction 
of demand flow in one route complements that of the other 
route. Hence we plot the fraction of demand corresponding to 
the user, i.e., ft for user 1 and ft for user 2. In sequel we 
describe five experiments as follows: 

Experiment 1 ) Load balancing network with linear link cost: 
In Fig. |2(a)[|2(b)l we plot the cost and the flow obtained at 
Nash equilibrium versus a in the range [0, 1]. Note that the 
plot of user 1 and 2 overlap in the figure in symmetrical case. 
This is due to the same degree of Cooperation. 

Experiment 2) Parallel links with linear link cost: In Fig. 
|3(a)|3(b)] we plot the cost function and the flow for both users 
obtained at Nash equilibrium for a in the range of [0, 1]. 

Experiment 3) Load balancing network with M/M/l link 
cost: Consider the parameters for the link cost functions as, 
01 = 4 g i = l,o 3 = 2, ff2 = V 1 = 1.2, r 2 = 1. In Fig. 
|4(a)|4(b)] we plot cost and flow obtained at Nash equilibrium 
for < a < 1. 

Experiment 4) Parallel links with M/M/l link cost: In Fig. 
|5(a)|5(b)] we plot the cost function and the flow for both users 
obtained at Nash equilibrium versus a. 

Experiment 5) Load balancing network with linear link cost: 
We vary the link cost for I3 and I4 by varying the parameter c. 
More precisely, we increase c from to 1000 in the steps of 
20 and compute Nash equilibrium at each point. In FigO we 
plot the cost of each user with the increasing link cost of the 
link Is and I4. Note that when the link cost is high signifies 
that link doesn't exit. We analyze the results obtained from 
the experimentation done above. We will be using a and a 1 
alternatively here for simplicity as we have fixed a 2 = 1 for 
asymmetrical case and a 1 = a 2 for symmetrical case. The 
important behavior can be summarized under following two 
headings. 

B. Non uniqueness of Nash equilibrium 

In Fig. 12 we observe that there exist multiple Nash 
equilibria for both symmetrical case and asymmetrical case. 
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Fig. 2. Topology : Load balancing, Cost function : Linear, Parameters : a = 
1, c = 0, d = 0.5, Cooperation : { Symmetrical: a 1 = a 2 , Asymmetrical: 
< a 1 < l,a 2 = 0}. 



(b) Flow values at Nash equilibrium 

Fig. 3. Topology : Parallel links, Cost function : Linear, Parameters : a = 
l,c= Q,d = 0.5, Cooperation: { Symmetrical: a 1 = a 2 , Asymmetrical: 
< a 1 < I, a 2 = 0}. 



Note that multiple Nash equilibria is constrained to some 
range of cooperation(a). However there also exist some range 
of cooperation where unique solution exist. We observe that 
there exist three Nash equilibrium for some range of co- 
operation, two Nash equilibrium at one point and, unique 
Nash equilibrium for some range of cooperation. In Fig. [4- 
6](a,b), we obtain multiple Nash equilibria as above for some 
range of cooperation. In Fig. 03] although a 1 = a 2 , due to 
other parameter being non-symmetrical, we do not observe 
a symmetrical plot for "J 1 , J 2 -Symmetrical". Uniqueness of 
Nash equilibrium is shown in [2], for a similar situation as 
in Fig. [3] for selfish user, but we observe loss of uniqueness 
when users have some cooperation. 

C. Braess like paradox 

We also observe a Braess kind of paradox which is related to 
performance when additional resource is added to the system. 
To understand this, consider the topology of experiment 1, i.e., 
the load balancing network topology. Consider a configuration 
where initially link £3 and I4 has very high cost (effectively 
doesn't exist) and latter the link cost is reduced to a low value 
e.g. c = and d = 0.5. This can be interpreted as an additional 



resources added to the system. Observe than for the initial 
configuration the cost of user 1 is J 1 = 1 and cost of user 2 
is J 2 = 1 in experiment 1 . However in the latter configuration 
which is depicted in Fig. |2(a)| we observe the cost of user 
1 and 2 is greater that 1 at Nash equilibria. This explains 
degradation of performance when resources are increased. A 
very clearer observation can be made in Fig|6] where the link 
cost for link £3 and I4 is parameterized. Due to multiple Nash 
equilibria we see two curves. The lower curve corresponds to 
Nash solutions where flow for each user choose direct link to 
destination while the upper curve correspond to mixed strategy 
solution where a fraction of flow for each user choose direct 
link path. Notice that user cost is improving as the link cost is 
increasing for the upper curve. Such paradox is widely studied 
as Braess paradox in many literature. Above we identified 
the existence of Braess paradox in load balancing network. 
Now we identify the Braess paradox in parallel links topology. 
Consider the parameters as follows, =4.1 C; 2 = 4.1 r 1 = 
2r 2 = 1. Consider the scenario when initially the link 
does not exist, while latter they are added in the system. In 
other words, the initially the capacity C3 = 0, C4 = 0, and 
latter it is C 3 = 10, C 4 = 10. Note that when C 3 = 0, C 4 = 0, 
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Fig. 4. Topology : Load balancing, Cost function : M/M/l Delay, Parameters 
: C h = 4.1, Q = 4.1, Q 3 = 5,C< 4 = 5,r x = l,r 2 = 1, Cooperation: { 
Symmetrical: a = a 2 , Asymmetrical: < a 1 < l,a 2 = 0}. 
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flow at Nash equilibrium is trivially = l,// 2 = 1. In the 
following, we consider two scenarios of degree of cooperation 

Only one user is Cooperative : The degree of Cooperation 
taken in this case is a 1 = 0.93, a 2 = 0. On increasing 
the capacity C^^C^ from — > 10, the cost functions at 
Nash equilibrium are obtained as J 1 = 0.952 — > 2.06, 
J 2 = 0.3225 -> 0.909 and the flows are // 1 =2^0, 
/z 2 = 1 — > 0.0951. We also obtain another Nash equilibrium 
where the cost functions and the flow doesn't change from 
initial state. Note that increasing the capacity in the network 
degrades the performance at the first Nash equilibrium. 

Both users are Cooperative : We repeat the above ex- 
periment with the degree of Cooperation a 1 = 0.9, a 2 = 
0.9. The cost functions at Nash equilibrium are obtained as 
J 1 = 0.952 -> 1.247, J 2 = 0.3225 0.430. We again 
obtain another Nash equilibrium where the cost functions 
and the flow doesn't change from initial state. Note that 
again increasing the capacity in the network degrades the 
performance at the first Nash equilibrium. 



D. Paradox in cooperation 

In Fig. |2(a)| we observe that J 1 has higher cost than J 2 . 
This is intuitive because user 2 is selfish user while user 1 
has a varying degree of Cooperation. In particular remark that 
ct 1 i 0, J 1 t J 2 - But this is not true for the whole range of 
Cooperation. Observe in Fig. (3. a) a non intuitive behavior for 
some small range of a 1 (approximately a 1 € (0.87, 1). Notice 
that when the degree of cooperation a 1 increases (i.e. increase 
in its altruism) while other user be pure selfish (a 2 = 0), leads 
to improved cost of user 1. This is a paradoxical behavior, 
we call it paradox in cooperation. This paradox also exist 
in case of symmetrical cooperation (see J 1 -Symmetrical, J 2 - 
Symmetrical ) in the range of a approximately (0, 0.4). Notice 
that such paradox is still observed in Fig. [3]|4] Remark that 
such paradox exist only when there are multiple equilibria. 

IV. Mixed Equilibrium 

The concept of mixed-equilibrium (M.E.) has been intro- 
duced by Harker [14] (and further applied in [16] to a dynamic 
equilibrium and in [15] to a specific load balancing problem). 
Harker has established the existence of the M.E., characterized 
it through variational inequalities, and gave conditions for its 
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Fig. 6. Topology : Load balancing, Cost function : Linear, Parameters 
a\ = 4.1, (22 = 4.1, d = 0.5, Cooperation^ 1 = a 2 = 0.93 . 



uniqueness. We discuss here the behavior of mixed equilibrium 
in presence of partial cooperation. Consider the network (V, C) 
shared by two types of users: (i) group users (denoted by 
TV) : these users have to route a large amount of jobs; (ii) 
individual users; these users have a single job to route through 
the network form a given source to a given destination. There 
are infinitely many individual users. For simplicity, we assume 
that all individual users have a common source s and common 
destination d. Let V be the set of possible paths which go from 
s to d. 

Cost function 

- J % : F — > [0, oo) is the cost function for each user i e Af 

- F p : F — >■ [0, oo), is the cost function of path p for each 
individual user. 

The aim of each user is to minimize its cost, i.e., for i e AT, 
minji J'(f) and for individual user, min pe -p F p (f). Let fp be 
the amount of individual users that choose path p. 

Definition 3 f€Fisa Mixed Equilibrium (M.E.) if 

V* e X.: f i'sj.:f G F, j*(f) < J l (T\g l ) 
Vp G V, F (p) (f) - A > 0; (F (p) (f) - A)f\ p) = 

where A = min pe -p J- p (f ) 

A. Mixed equilibrium in parallel links 

In the following proposition, we provide some closed form 
of Mixed equilibrium in parallel links. 

Proposition 1 Consider parallel links network topology (Fig. 
\l(b)\ and M/M/l delay link cost function. Consider that a 
Group type user and Individual type users are operating in 
this network. The mixed equilibrium strategy (// , ff ) can 
be given exactly as follows, 

1) When Both link is used at Wardrop equilibrium: 
{ (Mi.JVi) if ai < Mi < b\] 
otherwise 

(0, -CC) ifn < miafra+C-d, »(P a -gi>+*"* ) , 

(ri,ri-Cc) ifn < miii p^-f^ .ra-CCa-Ci)), 



"1 



II r _ -o(C 2 -C 1 ) + r 1 (2o-l) AT _ (C 1 -C 2 )(l-o) + (2o-l)r- 2 
m l 2(2c-l) 1 JV 1 2(2cv-l) 1 

"L_ra^n i0)j ^ = min( „SL_ci + n+i2 >ri)) 



max( — 



CC = - 



g 2 ~ C 1 



dd 



2) When only one link (I) is used at Wardrop equilibrium: 

{ (M 2 ,0) if Cl <M 2 <r i; 
otherwise 

( Cl ,o) ifh(n)>o, 
{ (n,o) ifh(n)<o, 

where c 1 = max(- ° 2 ~ Cl - ^^,0) and M 2 is the 
unique (if there exists) root of the quadratic equation 



h(x) 



bx + c = Q 



in [ci, ri]. The coefficients of the quadratic equation are 

o=((Ci-C a +ra)(l-a)-ar2); 6=(Ci(l-a)(2(Cj!-ra-ri) 
+2(C2-r 2 ))+2Qr 2 Ci); c=Ci (l-o) [(C 2 -n -r 2 ) 2 
-Ci(C3-r 2 )]-ar 2 C?. 

3) When only one link (2) is used by Wardrop user: 

' (M 3 ,r 2 ) ifQ<M s <dr, 
otherwise 

(0,r 2 ) */M0)>0, 
(di,ra) i//i(0)<0, 

w/zere di = min(- C2 ~ c ' 1 + l2 ± Ii ^i) M 3 W f/ie 
unique root( if there exist) of the quadratic equation 



5<» 



ax 



bx 







in [0, di]. 77ie coefficients of the quadratic equation are 

a = ((Ci-C 2 +r 2 )(l-Q)-ar 2 ); 6=(Ci(l-a) 
(2(C 2 -r 2 -n)+2(C 2 -r 2 ))+2Qr 2 Ci); c=Ci(l-a) 
[(C 2 -r 1 -r 2 ) 2 -Ci(C 2 -r 2 )]-ar 2 C 2 . 

Proof: We first state the general condition for the mixed 
equilibrium to exist. Based on link uses, there are 3 scenarios 
when Wardrop conditions can be met for equilibrium to exist. 
We individually state each of them and then we establish the 
conditions for equilibria. 

For link cost to be finite the link flow must satisfy the 
flow constraint fi l < C\, fi 2 < C 2 - From this we obtain 
the general condition r\ + r 2 < C\ + C 2 . Equilibria can be 
attained in the following conditions: 

1) When both link is used by Wardrop users: Wardrop users 
utilize both the links, i.e., > 0, ff > 0, implies 
cost of both links are same, i.e., Ti 1 (/; 1 ) = Ti 2 (fi 2 ) 
(we use T; 1 (/; 1 ) instead of ^ 7 ; 1 (/z 1 ) from def. [3j. From 

TiAfh) = T l2 (f l2 ) => ff 2 = -cc+fl, o < fl < n, 

and < ff 2 < r 2 imply that a\ < ff < bi, 
where a\ = max(cc, 0), b\ = min(dd, r\), 

CC = -Qs=^X _ rSLzIi and M = -£2_Cj_ + rairi^ 

Thus the necessary conditions for equilibrium to exist 
reduces to n + r 2 > \C\ — C 2 \ by noting cc < r\ and 
dd > 0. Thus the equilibrium strategy (/^ , ff ) is 
given by 



!(Mi, Ni) if ai < Mi < bi; otherwise, 
(0, ~Cc) if n < min(r 2 +C 2 -C 1 ,fe£lH±!12) i 

(ri,n -cc) if n < min( "^-^ ,r 2 -(C 2 -Ci)) , 

where 

71 r - Q (C 2 -Cl) + r-i(2 Q -l) AT _ (Ci-C 2 )(l-a) + (2c.-l)r2 

1 "1 2(2q-1) J J, J- 2(2a-l) 

Note that J 1 (/;* > if ) is strict convex in the range 
< ft < ri,0 < ft' < r 2 ( by definition of 
M/M/l cost function). It can be directly inferred that 
if the equilibrium point (Mi, N±) satisfies the condition 
ai < Mi < b±, (it is an interior point) there exist atmost 
one equilibrium. 

Otherwise when there is no interior equilibrium point, 
there may exist equilibrium at fl{ = or fl{ = n, 
i.e at point (0, — cc) or at point (ri,r\ — cc) (since 
Th(f h ) = Tl 2 (f h ) implies .ft = -cc + fl{). The 
point (0, — cc) can be an equilibrium point only 
when ai = max(0, cc) = and J' 1 (0, cc) > 0. 
This directly implies r\ < r 2 + (C 2 — Ci), and 
7"i < a ( c 2-^c 1 )+2ar 2 reS p ec ti ve iy Combining these, 

we get n < mm jr 2 + (C 2 - Ci), v 2a l ; 1 r - j. 

Following the similar steps we can directly obtain that 
point (n , ri — cc) can be an equilibrium point when 

n <min{ a( ^- a Cl) ,r 2 -(C 2 -Ci)}. 

2) When only one link (link 1) is used by Wardrop user: 
In this case, Wardrop users utilize only link 1, i.e., ff = 

0. This directly implies T h (f h ) < T h (f h ) => ft < cc 
(from wardrop condition). Combining the above with 
positive flow condition < ft < n, we obtain 
< ft < ci, where ci = min {cc, n}. Since Ci must 
be greater than 0, the necessary condition for equilibrium 
to exist reduces to n — r 2 > C\ — C 2 . Further the 
equilibrium strategy (ft , ft ) is given by 

' (M 2 ,0) if < M 2 < ci; 

otherwise, 

(0,0) if h(0) > 0, 

k (ci,0) if h(0)<0, 

where M 2 is the unique root of quadratic equation 

h{x) = ax 2 +bx + c. Let x x = ~ b ^f E r , x 2 = "^/^ 
are the roots of the Quadratic equation /i(x) = 0, 
where a = (C\ — C 2 — r 2 )(\ — a) + ar 2 ; b = 2(1 — 
a)[(C x - r 2 )(2(C 2 - r 2 ) + n)] + 2ar 2 (C 2 - n); c = 
(1 - a)(Ci - r 2 )[{C 2 - n) 2 - (C 2 - n)(Ci - r 2 ) - 
n(Ci - r 2 )] + ar 2 (C 2 - ri) 2 ; D = b 2 - Aac. 
The quadratic equation h(x) = will have unique 
solution in the range < fl < n because J' 1 (/j 1 , 0) is 
strict convex in the range < fl < n ( by definition 
of M/M/l cost function). Hence there can be atmost one 
equilibrium point satisfying < M 2 < ci(i.e single 
interior point). 

Otherwise when there is no interior equilibrium point, 
there may exist equilibrium at fl\ = or fl\ = n, 

1. e., at point (0,0) or at point (ri,0). The point (0,0) 
can be an equilibrium point only when J' 1 (0,0) > 0, 



i.e., h(Q) > 0. Similarly point (ci, 0) can be equilibrium 
point only when J' 1 (0,0) < 0, i.e., h(0) < 0. 
3) When only one link (2) is used by Wardrop user: 

In this case Wardrop users utilize only link 2, i.e., ff 2 = 
r 2 . Following the similar steps as before, we obtain di < 
fl < ri, where d\ = max{dd, 0}. Since d\ must be 
less than r\, the necessary condition for equilibrium to 
exist reduces to n — r 2 < C 2 — C\. 
Further the equilibrium strategy {fl , ff 2 ) is given by 

r (M 3 ,r 2 ) if di <M 3 <r i; 
I otherwise 

\ (0,r 2 ) if h(ra)>0, 

[ {d u n) if h(r 2 ) < 0, 

where M 3 is the unique root(if there exist) of the 
quadratic equation g{x) = ax 2 + bx + c in d\ < 
ft < n. Let x x = ^±^,x 2 = are the 

roots of the Quadratic equation g{x) = 0, where a = 
((Ci-C 2 +r 2 )(l-a)-ar 2 ); b = (1 - a)[4Ci(C 2 - 
n-r 2 )+2riCi]-2ar 2 Ci); c = (l-a)[(C 2 -n-r 2 + 
Ci)Ci(C 2 - ra -n) -nC?] + araC?; D = b 2 - 4ac. 
The quadratic equation g(x) = will have unique 
solution in the range < fl < r\ because J' 1 (f\,r 2 ) 
is strict convex in the range < fl < r\ ( by definition 
of M/M/l cost function). Hence there can be atmost one 
equilibrium point satisfying d\ < M 3 < ?*i(i.e single 
interior point). 

Otherwise when there is no interior equilibrium point, 
there may exist equilibrium at fl\ = or fl\ = r±, i.e., 
at point (0, r 2 ) or at point (n, r 2 ). The point (0, r 2 ) can 
be an equilibrium point only when J n (0,r 2 ) > 0, i.e., 
g(r 2 ) > 0. Similarly point (ri,r 2 ) can be equilibrium 
point only when J' 1 (0, r 2 ) < 0, i.e., g(r 2 ) < 0. 

Corollary 1 Consider the symmetric parallel links, i.e., 
(Ci = C 2 = C, r\ = r 2 = r) network with M/M/l 
delay link cost function. In a mixed user setting the 
mixed equilibrium strategy ( (fl , / 2 )) can be given by 
(§,§) when n> ft >0,r 2 >/f 2 >0 
(0, 0) when < ft < n, ft =0, if a > 0.5 
(r, r) when < ft < n, ft =0, if a > 0.5 

Proof: 

Consider the symmetric case when C\ — C 2 = C, r\ 
r j = r. The general condition thus reduces to r < C from 
prop. [U Equilibrium can be attained under the following 
scenario based on link uses. 

1) When both link is used by Wardrop users: 

Wardrop users utilizes both the links, i.e., 
ff > 0, ff > 0, implies cost function of both 
the links are same, i.e., T; 1 (/; 1 ) = T; 2 (/; 2 ). From 

Tidfh) = T h (fh) => ff 2 = fl, < ft < r, and 
< ff < r, implies that necessary condition for 
equilibrium to exist are always satisfied. Further the 
equilibrium strategy (ft , ft 2 ) is given by (|, §) which 
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Fig. 7. Topology : Parallel links, Cost function : M/M/l Delay, Parameters 
: C h =4,C h =3,r 1 =1.2,r 2 = l . 



also. 

V. Existence and uniqueness of Equilibrium 

Having noted the existence of multiple Nash equilibrium 
in sec lIII-Al using various examples, we here establish the 
conditions under which unique nash equilibrium exist. Unique- 
ness of Nash equilibrium is shown in [2] in case of non- 
cooperative games for parallel links topology. Under some 
condition, uniqueness is shown for general topology also. In 
this section we follow the similar structure to establish the 
uniqueness for parallel links topology in case of our setting 
of user cooperation. 

We follow some assumptions on the cost function J 1 same 
as in [2]. 



can be directly obtained from prop. (H]l). 

2) When only one link (link 1) is used by Wardrop user: In 
this case, Wardrop users utilize only link 1, i.e., f? = 0. 
This directly implies T h (f h ) < T h (f h ) f( < 
(from wardrop condition). Combining the above with 
positive flow condition < < ri, we obtain = 
0. This suggests that equilibrium point can be given by 
(#,/£") = (°>0) if there exist. 

Note that (0, 0) is the boundary point solution. If 
J' 1 (0,0) > (Nash solution of user 1) then the 
equilibrium point is given by (0,0). J 1 (Z; 1 , 0) can be 
expressed as ^fy, where 
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ax 
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a = r(2a-l); b = 2(C-r)(2(C-r)(l-a)+r); c = 
(2a-l)r(C7-r) 2 ; D = 1&{C -r) 2 {l-a)C[{C -r){l- 
a) + ar] and Q(x) > for all x, thence J' 1 (0,0) > 
0^c>0^a> 0.5. 

When only one link (2) is used by Wardrop user: In this 
case, Wardrop users utilize only link 2, i.e., ff = r. 
This directly implies T h (f h ) > T h (f h ) => f\ > r 
(from Wardrop condition). Combining the above with 
positive flow condition < fl < ri, we obtain fl = 
r. This suggests that equilibrium point can be given by 

(fh > fh ) = ( r ' r ) if there exist 

Remark that this case is symmetrical to case when only 
link 1 is used. Hence we can directly infer the condition 
for equilibrium point to exist. The equilibrium point 
point (r, r) exist, when a > 0.5. 
In Fig. 0, we depict the mixed equilibrium strategy(flow) 
for the varying degree of cooperation(a). Observe the loss 
of uniqueness of mixed equilibrium in presence of partial 
cooperation. It is known to have unique equilibrium in the 
network setting with finitely many selfish users [15]. Remark 
that we have already shown in the previous section that 
there exist multiple Nash equilibria in presence of partial 
cooperation. Due to space limitation we illustrate this behavior 
with only parallel links topology and M/M/l cost function. 
However we identify a similar remark from other configuration 



Gl 
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G4 



J'(f) = J2iec Jl(fi))- Each J\ satisfies: 
J/:[0,oo) — > (0, oo] is continuous function. 
J\: is convex in f[ for j — I, 
Wherever finite, J\ is continuously differentiable 

in fl, denote K\ = |i. 



Note the inclusion of +oo in the range of J\, which is useful 
to incorporate implicitly and compactly and additional con- 
straints such as link capacities. Also note that the assumption 
G3 is stronger than in [2]. 

Function that comply with these general assumptions, we 
call type G function. For selfish user operating on parallel 
links NEP is shown to exist in [2] with the function which 
comply with the type G function. 

We shall mainly consider cost functions that comply with 
the following assumptions: 

Assumption V.2 : 

Bl: J l (f) = EiecfiTi(fi)) 
B2: Ti : [0, oo) -> (0, oo]. 

B3: Ti(f) is positive, strictly increasing and convex. 
B4: Ti(fi) is continuously differentiable. 

Functions that comply with these assumptions are referred 
to as type-R functions. 

Remark 1 In Assumption Bl, Ti(fi) is the cost per unit of 
flow (for example mean delay) on the link I, for the total 
utilization, fi = YliPifv of that link. Note that if Ti(fi) 
is the average delay on link I, it depends only on the total 
flow on that link. The average delay should be interpreted as 
a general congestion cost per unit of flow, which encapsulates 
the dependence of the quality of service provided by a finite 
capacity resource on the total load fi offered to it. 

A special kind of type-B cost function is that which corre- 
sponds to an M/M/l link model. In other words, suppose that 
CI: J l (fl, ft) = fifiift) is a type-B cost function. 

fi<Q 
fi>Q ■ 



C2: T, 



c, - 
oo 



fl 



Where C; is the capacity of the link I. 



Function that comply with these requirements are referred to 
as type-C functions. Such delay functions are broadly used in 
modeling the behavior of the links in computer communication 
networks [11], [12]. 

A. Parallel links network topology 

In this section we study the special case where the users 
from set X shares a set of parallel communication links C = 
{1,2....L} interconnecting a common source node to a com- 
mon destination node. In [2], uniqueness of Nash equilibrium 
is shown for the selfish users (when user do not cooperate in 
managing the communication link) in parallel links, where the 
cost functions (,P (f )) of users are assumed to hold assumption 
IV.2I However this is not true when the users have cooperation 
in degree as defined in sec.©. We observe that assumption 
IV.2I is not sufficient to guarantee unique Nash equilibrium 
in our setting. It is a harder problem to characterize system 
behavior for general degree of cooperation. Hence we consider 
a special case of cooperation where a user cooperative with 
similar cooperation with all other users i.e. 

J'(f) = (1 - a 1 ) J*(f) + a 1 J2 Jk (f) 

k 

Consider the cost function of type IV. 2 1 The cost function of 
each user on link I is given by 

j/(f) = ((l-a^fi + rffrWift) 

Existence problem in the case of Nash equilibrium for the 
cost function J/(f) can be directly studied as in [2]. 

Note that in case of a 1 < 0.5 for all i £l, the uniqueness 
of Nash equilibrium is guaranteed from E. Orda et al. [2]. 
Note that when a 1 < 0.5, the function K^f^ 1 , fi) is strictly 
increasing function in and 

Uniqueness of Nash equilibrium can be also observed in 
case of All-positive flow in each link. By All-positive flow we 
mean that each user have strictly positive flow on each link of 
the network. 

The following result establishes the uniqueness of Nash 
Equilibrium in case of positive flow. 

Theorem V.l Consider the cost function of type \V.2\ Let f 
and f be two Nash equilibria such that there exists a set of 
links C\ such that {fl > and fl > 0,i G 1} for I G L\, 
and {fl = ff = 0,ie 1} for I ~Zy. Then f = f . 

Proof: Let f e F and f e F be two NEP's. As observed f 
and f satisfy the Kuhn-Tucker condition. We rewrite the Kuhn- 
Tucker condition in terms of fj~ l , ft as below, 

K\(fr\ fl) > A 4 ; Kl{ff \ /,) = A* if ft > Vi, I 
KKfr, fl) > A*; Kj(ff\ fa = X 1 if ft > Vi, I 

The above relation and the fact that -K|(.; .) is increasing in 
both of is argument will be used below to establish that f = f 
i.e. ft = fi for every /, i. The first step is to establish that 



/; = // for eacn link I. To this end, we prove that for each I 
and i, the following relation holds: 

{A 4 < X\fi > fi} implies that f~* < f~\ (4) 
{A 4 > A*, fi < fi} implies that f~* > f~\ (5) 

We shall prove since (|5]l is symmetric. Assume that 
A 4 < A and /; > /; for some I and i. For f\ > together 
with our assumptions imply that: 

KiUr ,fi) = X< A ?; < K\ (ff l ,fi)<Kl(f-\fi), (6) 

where the last inequality follows from the monotonicity of 
K\ in its second argument. Now , since K\ is nondecreasing 
in its first argument, this implies that / ; ~' < fi, and (|4]i is 
established. 

Let Ci = {I : fi > fi}. Also denote l a = {i : X 1 > A 1 }, 

£2 = C — Ci = {I : / < fi}. Assume that L\ is non empty. 

Recalling that J2i fj l = J2i /; * = r ~*' il follows from $5$ 
that for every i in 2 a , 

;g£i ie£ 2 iec 2 leCi 

From ©, we know that , /p < ff l for I e C\ and i £ I a , 
it follows that : 

leCi led leCi leCi 

This inequality obviously contradicts our definition of C\. 
Which implies that L\ is an empty set. By symmetry, it may 
also be concluded that the set {I : fi < /;} is also empty. 
Thus, it has been established that: 

/; = fi for every I 6 C. (7) 

We now show that A' = A 1 for each user i. To this end, note 
that may be strengthen as follows: 

{A ? < X\ Xfi = fi} implies that either 

fr < fr °r fr = ir = o. <® 

Indeed if /, _ * = 0, then the implication is trivial. Otherwise, 
if ff l > 0, it follows similar to © that Ki(f^\fi) that 
f^ 1 < f^ 1 as required. Assume now that X < X 1 for some 
i e 1. Since J2iec K % = T ~ l > °- then /f ' > for at least 
one link / and from ((HJ implies that, J2 leC fl > 2~2iec fl ~ 
r% which contradicts the demand constraint for user i. We, 
therefore, conclude that A' < A 1 does not hold for any user i. 
A symmetric argument may be used to show that A' = A 4 for 
every user i S I. Combined with ([TJ, this implies by (|4]i and 
© that /p* = for every Z, i. Again since ft = f - f^\ 
uniqueness of ft is proved. 

B. Uniqueness of NEP in general topology 

It is a hard to characterize system behavior for general 
network with user's partial cooperation. For selfish users, it 
is shown that there exist uniqueness for Nash equilibrium 
point(NEP) under Diagonal Strict Convexity in [2]. 



We consider a special case of cooperation where a user 
cooperates equally with all other users i.e. 

J'(f) = (1 - a 1 ) ,P(f) + a l J2 Jk ( f ) 

k 

Consider the cost function of type IV. 2 1 The cost function of 
each user on link I can be thus given by 

J/(f) = ((l-a*)f l + (l-2a*)f^)T l (f l ) (9) 

Theorem V.2 Consider the cost function of type W.2\ Let f 
and f be two Nash equilibria such that there exists a set of 
links L\ such that {ft > and ft,i <E 2} for I <E C\, and 
{ft = ft =0,ie 1} for I £ Zi. Then f = f . 

Under all positive flows assumption, the Kuhn-Tuker condi- 
tions for all I = (u, v) £ becomes 

((l-a i )/, i +a i /r i )Tj'(/ ( )+(l-a < )Ti(/ ! )=^-^ 
((l-a^fJ+a'f-^TlifO + il-a'mif^Xi-Xi 

Summing each of these equations over i, we obtain 

ff^(/i)~(aI+l-2a)T/(/,)+/(l-a)T,(/ 1 )=X„-A„ 
H uv (A)~(aI+l-2a)fiT;(fi) + ^-ct)m(fl)=%u-Xv 

Since the function H is strictly increasing, we follow the same 
proof of Theorem 3.3 in [2] to conclude that f = f . 

VI. Concluding Remarks 

This paper is aimed at exploring user performance in routing 
games where a finite number of users take into account not 
only their performance but also other's user's performance. 
We have parameterized the degree of Cooperation to capture 
the user behavior from altruistic to ego-centric regime. We 
notice some strange behaviors. Firstly we show the existence 
of multiple Nash equilibria by a simple example of parallel 
links and load balancing networks in contrast to the unique 
Nash equilibrium in case of selfish users. Moreover, we then 
explored the mixed user scenario, which is composed of a 
finite number of Group type user seeking Nash equilibrium 
and infinitely many Individual type users satisfying Wardrop 
condition. We illustrate loss of uniqueness of equilibrium even 
in mixed users scenario in presence of partial cooperation by 
an example for parallel links network. However it is known 
to have unique equilibrium in presence of only finitely many 
selfish users in similar settings. 

Secondly we identify two kinds of paradoxical behavior. We 
identify situation where well known Braess paradox occurs 
in our setting of cooperation. We show using an example of 
parallel links network with M/M/l link cost that addition of 
system resources indeed degrades the performance of all users 
in presence of some cooperation, while it is well known that 
this is not true for this setting with only selfish users. 

We also identify another type of paradox, paradox in cooper- 
ation: i.e. when a given user increases its degree of cooperation 
while other users keep unchanged their degree of cooperation, 
this may lead to an improvement in performance of that given 
user. In extreme sense a user can benefit itself by adopting 
altruistic nature instead of selfishness. 
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